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Abstract 


The  construction  of  the  macrostructure,  or  abstracted  main 
content,  for  a  passage  should  be  based  on  the  semantic  content  of 
the  passage  together  with  the  reader’s  general  knowledge,  but 
guided  or  influenced  by  superficial  features  such  as  what  the 
initially  mentioned  information  is.  Passages  were  studied  that 
varied  in  the  familiarity  of  their  content,  and  in  their 
structure  according  to  the  macrostructure  theory.  One  type  of 
passage  was  based  on  a  generalization  followed  by  specific 
examples;  a  second  type  was  based  on  a  conclusion  followed  by  a 
supporting  argument.  Each  passage  appeared  in  either  a  good 
version,  in  which  the  main  idea  was  explicitly  stated  in  the 
first  sentence,  and  in  a  bad  version  with  no  explicit  statement 
of  the  main  idea.  For  each  passage,  the  subjects  provided 
reading  times,  ratings  of  the  importance  of  individual  passage 
sentences,  and  one-sentence  statements  of  the  main  ideas  which 
were  analysed  for  differences  in  content.  The  results  show  that, 
in  arriving  at  their  statements  of  the  main  ideas,  readers  make 
use  of  both  semantic  and  superficial  properties  of  the  passage. 
In  particular,  they  can  recognize  highly  thematic  sentences  even 
in  unfamiliar  material;  they  make  very  direct  use  of  explicit 
statements  of  the  main  idea;  if  the  main  idea  is  not  explicit, 
they  can  infer  one  if  the  passage  material  is  familiar;  and  they 
can  organize  even  an  unfamiliar  passage  around  alternative  forms 
when  the  main  idea  is  not  explicit.  An  informal  process  model 
for  the  process  of  abstracting  main  ideas  is  presented  that 
summarizes  these  results. 
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Abstracting  Main  Ideas  from  Technical  Prose: 
A  Preliminary  Study  of  Six  Passages 


David  E.  Kieras 
University  of  Arizona 


The  theory  of  textual  macrostructure  proposed  by  van  Dijk 
(1977a,  1977b)  and  Kintsch  and  van  Dijk  (1978)  attempts  to 
describe  how  readers  abstract  the  gist,  or  important  content, 
from  prose.  In  this  theory,  the  reader  first  extracts  from  the 
text  a  set  of  microstructure  propositions  that  correspond  to  the 
directly  expressed  content  of  the  text,  and  then  constructs  a  set 
of  macrostructure  propositions  which  in  some  sense  subsume  or 
summarize  the  microstructure  propositions.  If  the  reader's  task 
is  to  produce  a  summary,  he  or  she  would  simply  state  this 
macrostructure  in  the  form  of  prose.  If  the  reader's  task  is  to 
remember  the  passage,  he  or  she  will  give  priority  in  memory 
encoding  effort  to  the  macrostructure  propositions  over  the 
microstructure  propositions  that  simply  supply  details.  Hence 
later  recall  will  tend  to  consist  of  the  passage  macrostructure, 
and  so  will  be  highly  condensed  and  concerned  with  the  main 
points  rather  than  details. 

The  macrostructure  theory  can  be  contrasted  briefly  with  two 
related  notions;  schemata  (see  Kintsch  and  van  Dijk,  1978),  and 
scripts  (Schank  and  Abelson,  1977).  In  the  sense  of  Kintsch  and 
van  Dijk,  textual  schemata  express  stereotyped  organizational 
forms,  such  as  the  standard  plot  lines  use  in  stories.  Scripts 
express  stereotyped  sequences  of  events,  the  favorite  example 
being  what  happens  when  one  enters  a  restaurant.  There  seems  to 
be  general  agreement  that  the  the  comprehension  of  ordinary 
story-like  material  should  be  explainable  in  terms  of  script  and 
schema  notions.  A  central  feature  of  these  notions  is  that  the 
reader  can  comprehend  using  a  "fill  in  the  slots"  approach. 

However,  technical  prose  does  not  seem  amenable,  at  first 
glance,  to  treatment  in  terms  of  scripts  and  schemata.  An 
obvious  counter-example  to  this  claim  is  that  experimental 
psychologists  have  a  schema  for  an  experimental  article,  and 
probably  have  scripts  for  various  common  sequences  of  events  in 
scientific  activities. 

However,  the  key  feature  of  schema  and  script  theories  is 
that  the  prose  material  has  some  stereotyped  features.  But  the 
most  outstanding  property  of  technical  prose  is  that  it  expresses 
information  that  most  readers  find  novel.  This  seems  to  be  a 
strong  argument  against  the  use  of  script  theory  for  technical 
prose.  It  may  be  a  criticism  of  schema  theory  as  well.  However, 
there  may  be  standard  organizational  forms  for  technical  passages 
of  paragraph  length,  such  as  the  materials  used  in  this  work. 
Whether  such  standard  organizational  forms,  or  schemata,  in 
technical  prose  have  psychological  reality  for  ordinary  readers 


has  yet  to  be  determined.  Examples  of  possible  forms  that  will 
be  considered  more  below  are:  (a)  a  generalization  followed  by 
specific  examples;  (b)  a  conclusion  followed  by  an  argument 
supporting  it;  and  (c)  a  sequence  of  facts  leading  up  to  a 
conclusion  or  climax. 

Even  if  such  organizational  forms  are  present  in  technical 
passages,  it  is  not  clear  that  such  forms  are  used  in  a  "fill  in 
the  slots"  manner.  The  problem  is  that  the  reader  has  little 
information  before  reading  the  passage  about  which  schema  it  will 
follow;  only  after  seeing  the  relationship  between  the  ideas  in 
the  passage  could  he  or  she  classify  the  underlying 
organizational  form. 

All  these  considerations  suggest  that  the  macrostructure 
theory  may  be  the  most  useful  current  theory  to  apply  to 
technical  prose,  since  it  contains  rules  for  abstracting  the 
important  content  of  the  passage  without  necessary  recourse  to  an 
organizational  schema  for  the  passage.  Van  Dijk  (1977a,  1977b) 
has  proposed  macro-rules  that  generate  macropropositions  given  a 
passage  microstructure  and  general  knowledge.  These  rules 
operate  on  the  semantic  content  of  the  passage  and  of  long-term 
memory.  Of  particular  interest  here  are  van  Dijk's 
GENERALIZATION  and  CONSTRUCTION  rules.  The  GENERALIZATION  rule, 
stated  verbally,  says  that  a  set  of  micropropositions  can  be 
replaced  with  a  macroproposition  whose  terms  are  supersets  of  the 
corresponding  terms  of  the  microstructure  propositions.  The 
CONSTRUCTION  rule  states  that  a  set  of  microstructure 
propositions  can  be  replaced  with  a  macroproposition  that  either 
implies  or  is  implied  by  the  micropropositions.  Notice  that  the 
GENERALIZATION  rule,  based  only  on  superset  relations,  seems  to 
be  considerably  simpler  and  more  clear-cut  than  the  CONSTRUCTION 
rule.  In  both  rules,  it  is  assumed  that  the  macropropositions 
could  be  either  expressed  explicitly  by  the  passage,  in  which 
case  the  rules  operate  to  select  or  identify  the 
macropropositions,  or  only  implied  by  the  passage,  in  which  case 
the  rules  act  to  generate  the  macropropositions,  a  process  which 
could  involve  heavy  use  of  long-term  memory  information. 

As  presented,  the  building  of  macrostructure  is  based 
strictly  on  the  semantic  content  of  the  passage,  together  with 
related  semantic  information  in  long-term  memory.  However,  it 
seems  reasonable  that  surface  features  of  the  passage  would  be 
important  in  indicating  the  important  content  in  the  passasge  as 
well.  Intuitively,  we  all  know  that  how  we  choose  to  phrase  or 
order  the  sentences  in  a  paragraph  is  rather  important  to  whether 
our  reader  gets  the  point.  From  a  linguistic  perspective,  there 
are  many  surface  features  associated  with  the  assignment  of  what 
is  relevant  anc  what  is  irrelevant  in  a  text  (van  Dijk,  1979). 
Finally,  there  is  some  empirical  work  showing  that  sentence 
surface  structure  and  the  ordering  of  information  in  a  passage 
affects  the  reader's  perception  of  the  important  content 
(Clements  1979,  Kieras,  in  press  (a),  in  press  (b)).  Of 
particular  importance  seems  to  be  initial  mention.  The 
first-mentioned  idea  or  item  tends  to  be  viewed  as  the  passage 
topic  just  by  virtue  of  its  position  (Kieras,  in  press  (a)). 


The  obvious  conclusion  to  be  drawn  is  that  the 
macrostructure  building  process  operates  mainly  with  the  semantic 
content,  but  is  guided  or  influenced  by  surface  properties  of  the 
passage.  Although  this  is  an  obvious  conclusion,  it  is  not  at 
all  obvious  how  the  process  actually  works.  This  paper  presents 
some  experimental  results  and  an  informal  model  of  how  the 
macrostructure  building  process  is  guided  by  the  passage  surface 
form,  especially  the  initially  mentioned  information,  but  still 
relies  heavily  on  inference  and  constructive  processes  based  on 
general  knowledge. 

The  experimental  approach  is  based  on  that  in  Kieras  (in 
press  (a),  in  press  (b)).  Subjects  are  shown  passages  to  read 
and  are  asked  to  state  the  main  idea  of  the  passages  as  single, 
brief,  complete  sentences.  These  response  were  analyzed  both 
with  a  simple  classifcation  system,  and  with  a  detailed 
propositional  system.  In  addition,  reading  times  for  the 
passages  were  collected,  along  with  rankings  of  the  importance  of 
passage  sentences.  A  sample  of  passages  was  used  that  varied 
widely  in  the  amount  of  prior  knowledge  people  have  about  the 
content.  Two  kinds  of  passages  were  used:  One  was  based  on  the 
GENERALIZATION  rule.  These  consisted  of  a  series  of  specific 
examples  of  a  generalization  main  idea,  which  either  appeared 
explicitly  in  the  first  sentence  (the  good  version),  or  was 
absent  (the  bad  version).  The  other  type  of  passage  was  based  on 
the  CONSTRUCTION  rule.  Here  the  main  idea  was  an  inference  or 
conclusion  that  was  followed  by  a  series  of  facts  supporting  it. 
In  the  good  version,  the  main  idea  again  appeared  in  the  first 
sentence;  in  the  bad  version  the  main  idea  was  not  explicitly 
stated.  One  group  of  subjects  simply  read  each  passage,  with  the 
reading  time  recorded,  and  then  produced  a  statement  of  the  main 
idea.  A  second  group  provided  importance  ratings  of  the  passage 
sentences  before  stating  their  main  ideas. 


Method 

Materials.  Ten  passages  were  prepared,  each  in  a  good  and  a 
bad  version .  Three  passages,  the  Generalization  passages,  had 
the  form  of  a  general  statement  followed  by  several  specific 
examples  of  the  generalization,  with  several  less  relevant 
sentences  included.  These  passages  are  shown  in  Tables  1,  4,  and 
7  below,  and  will  be  refered  to  as  the  metals,  timekeeping,  and 
i nstruments  passages.  The  good  version  included  a  statement  of 
the  intended  generalization  as  the  first  sentence.  In  the  bad 
version,  the  general  statement  was  removed  and  replaced  by 
another  specific  sentence  to  produce  a  similar  overall  passage 
length.  The  specific  form  of  the  bad  version  varied  somewhat 
between  the  passages. 

Three  other  passages  represented  a  Uniqueness  manipulation. 
In  the  good  version,  the  passage  began  with  a  statement  of  the 
main  idea,  and  the  passage  was  intended  to  be  based  on  this 
single  unique  main  idea.  In  the  bad  versions,  the  last  sentence 
or  sentences  stated  a  second,  related,  but  conflicting  main  idea. 
No  noteworthy  effects  were  observed  with  these  passages,  and  so 
they  will  not  be  described  or  discussed  further. 


Finally,  four  passages,  tran  spor tati on ,  Watergate ,  Jutland  , 
(shown  in  Tables  10,  13,  and  16)  and  chess ,  were  composed  that 
should  rely  on  the  CONSTRUCTION  rule.  In  the  good  versions,  the 
c onstruction  passages  began  with  a  sentence  stating  the  intended 
main  idea  in  a  direct,  explicit  fashion.  This  main  idea  was  one 
that  could  be  inferred  from  the  passage,  given  adequate  knowledge 
of  the  subject  matter.  In  the  bad  Versions,  this  sentence  was 
replaced  with  a  sentence  that  was  a  satisfactory  initial 
sentence,  but  did  not  state  the  intended  main  idea.  As  above, 
there  was  some  variation  in  how  this  was  achieved  in  the  four 
passages.  As  described  below,  the  chess  passage  turned  out  to  be 
defective,  and  will  not  be  further  described.  The  other 
construction  passages  are  shown  in  the  Tables  below. 

The  passages  were  justified  to  occupy  80-character  lines. 
They  ranged  from  9  to  12  lines  in  length,  with  the  two  versions 
of  each  passage  very  close  to  the  same  length.  A  numbered  form 
of  the  passages  was  then  prepared  by  inserting  the  sentence 
numbers  with  an  arrow-like  symbol  in  front  of  the  first  word  of 
the  sentence.  The  passages  were  then  rejustified  so  that  the 
numbers  were  embedded  in  a  passage  of  normal  appearance. 

Design  and  Subjects .  Two  groups  of  32  subjects  were  used, 
one  for  the  normal  main  idea  task,  the  other  for  the  importance 
rating  and  main  idea  task.  Within  each  group,  each  subject  read 
and  responded  to  one  version  of  each  passage,  five  of  them  being 
good  versions,  and  five  of  them  bad  versions.  The  assignment  of 
good  and  bad  versions  was  made  at  random  for  consecutive  pairs  of 
subjects,  with  the  members  of  each  pair  viewing  complementary 
versions  of  the  passages.  Hence,  for  an  even  number  of  subjects, 
each  passage  would  appear  equally  often  in  the  two  versions. 
Order  of  appearance  of  the  passages  was  separately  randomized  for 
each  subject. 

The  subjects  were  a  total  of  69  students  of  either  sex  at 
the  University  of  Arizona  recruited  through  advertisements  and 
paid  $2.00  for  participating.  Five  of  the  subjects  were  dropped 
due  to  failure  to  produce  complete  sentences  for  responses, 
resulting  in  the  final  64  subjects. 

Instructions .  The  instructions  were  very  similar  to  those 
used  in  Kieras ( in  press  (a),  in  press  (b)).  Subjects  were 
required  to  compose  a  statement  of  the  main  idea  of  each  passage 
which  met  the  following  rules:  The  response  had  to  be  a  single 
sentence  that  would  fit  on  a  single  line  of  the  computer  terminal 
(80  characters).  It  had  to  be  a  complete  sentence,  not  a  word  or 
phrase.  It  should  not  be  a  humorous  or  cute  response.  This  last 
instruction  was  the  major  change  from  the  earlier  work  just 
cited;  previously  subjects  were  required  to  produce  something 
that  was  "actually  mentioned"  in  the  passage.  Since  subjects  had 
rarely  produced  verbatim  excerpts  from  the  passage,  the 
conclusion  was  that  this  instruction  actually  had  the  effect  of 
discouraging  flippant  or  overly  "creative"  responses.  These 
instructions  thus  asked  that  subjects  avoid  such  responses.  For 
the  rating  task,  subjects  were  simply  instructed  to  list  the 
numbers  of  the  important  sentences,  the  most  important  first,  and 
continuing  for  as  many  as  desired. 
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Apparatus  and  Procedure .  The  experiment  was  run  with  a  Data 
General  MicroNOVA  lab  computer  which  allowed  running  three 
subjects  at  once  (Kieras,  1979).  Each  subject  sat  at  a  Teleray 
Model  3811  upper/lower  case  video  terminal  with  an  80  character 
by  2H  line  screen,  and  driven  at  9600  Baud.  The  computer 
performed  the  materials  randomization  and  recorded  reading  times, 
sentence  importance  ratings,  and  main  idea  responses.  Since 
reading  times  for  whole  passages  were  measured,  an  accuracy  of 
only  1  second  for  the  reading  times  was  used. 

Subjects  were  first  instructed  on  how  to  type  in  their 
responses  on  the  terminal  keyboard  and  allowed  to  practice. 
Subjects  who  were  not  comfortable  with  typing  were  allowed  to 
respond  by  writing  on  a  notepad.  Then  they  read  the  experimental 
instructions  and  began  the  experiment.  To  view  each  passage,  the 
subject  first  tapped  the  space  bar.  Subjects  in  the  normal  main 
idea  task  tapped  the  space  bar  again  when  they  finished  reading 
the  passage,  whereupon  the  passage  disappeared  and  was  replaced 
with  a  prompt  for  entering  their  main  idea  response.  Subjects  in 
the  rating  task  typed  in  their  list  of  sentence  numbers  while  the 
passage,  with  the  sentence  numbers,  was  still  on  the  screen. 
When  they  finished  typing,  the  passage  was  erased,  and  they 
entered  their  main  idea  sentence.  The  time  the  passage  was  left 
on  the  screen  was  recorded  as  the  reading  time,  but  is  not 
reported  for  the  sentence  rating  task  group.  The  time  required 
to  type  in  the  main  idea  was  recorded  as  well  but  did  not  vary 
with  any  manipulations  and  so  will  not  be  reported. 


Results 


Analysis  Methods 


The  basic  approach  in  the  analysis  was  to  treat  each  passage 
individually,  and  the  passage-by-passage  description  of  the 
results  is  presented  below. 

The  reading  times  for  the  group  performing  only  the  main 
idea  task  were  averaged  over  subjects;  these  means  will  be 
presented  for  each  passage.  The  sentence  importance  rating  were 
treated  as  follows:  The  first  mentioned,  or  most  important, 
sentence  in  the  list  was  given  a  rating  of  1,  the  second 
mentioned  a  rating  of  2,  and  so  forth.  Any  sentences  that  the 
subject  did  not  mention  were  given  a  rating  equal  to  the  number 
of  sentences  in  the  passage  plus  one.  The  mean  ratings  thus 
obtained  are  shown  for  each  sentence  in  each  passage  in  the 
Tables  below,  with  the  tables  arranged  so  that  the  different 
sequences  of  sentences  in  the  two  versions  can  be  distinguished. 

The  passages  to  be  described  all  produced  ratings  in  the 
good  version  giving  more  importance  to  the  intended  main  idea 
sentence  than  to  any  other  passage  sentence.  However,  the  chess 
passage  failed  to  have  this  property;  apparently  the  main  idea 
was  spread  out  over  the  first  three  sentence  in  the  good  version, 
and  was  concentrated  in  the  third  sentence.  Thus  the 
manipulation  of  whether  the  main  idea  was  present  or  not  misfired 
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for  this  passage.  Although  the  passage  produced  overall  results 
comparable  with  the  other  passages,  it  will  not  be  described  any 
further  since  the  intended  manipulation  did  not  work. 

The  main  idea  responses  were  analyzed  in  two  ways.  The 
first  method  was  to  simply  form  about  ten  or  fewer  categories  for 
the  responses  that  captured  the  major  kinds  of  responses,  and 
included  the  intended  main  idea  content  in  at  least  one  of  the 
categories.  The  was  done  blind  with  regard  to  the  version  of  the 
passage  associated  with  the  response.  The  responses  were  then 
tabulated  to  show  the  frequency  of  responses  in  each  category  for 
each  version  of  the  passage.  These  frequency  distributions  are 
shown  in  the  Tables  below  for  each  passage.  The  statistical 
questions  concern  whether  the  distributions  for  the  two  versions 
are  different,  and  whether  the  distributions  have  a  similar 
degree  of  dispersion,  which  indicates  the  consistency  of 
responses  for  the  versions.  Differences  in  the  distributions  was 
tested  with  the  usual  chi-square  test,  but  the  small  frequencies 
in  some  of  the  categories  distorts  this  test,  in  that  such  cells 
contribute  to  the  degrees  of  freedom,  but  will  contribute  little 
to  the  size  of  the  test  statistic.  Rather  than  aggregate 
categories,  which  in  this  case  would  be  rather  arbitrary  and 
confusing,  a  liberal  significance  level  of  .1  will  be  used.  In 
the  test  for  consistency,  a  procedure  had  tc  be  invented  since 
there  are  no  standard  procedures  for  testing  dispersion  in 
nominal  data.  This  procedure  consisted  of  first  making  the  two 
distributions  similar  in  shape  by  reordering  the  cells  for  each 
version  so  that  each  distribution  is  ordered  from  largest 
frequency  to  smallest.  Thus  if  the  two  reordered  distributions 
are  different  it  must  be  due  to  a  difference  in  how  spread  out  or 
dispersed  they  are.  This  was  tested  by  applying  an  ordinary 
chi-square  test  for  identical  distributions  to  the  reordered 
distributions.  Since  the  true  distribution  of  the  test  statistic 
is  unknown,  this  procedure  should  be  considered  suggestive  rather 
than  definitive.  For  the  same  reasons  as  above,  a  significance 
level  of  .1  was  used.  The  categorization  method  for  analyzing 
the  responses  has  the  advantage  of  being  simple,  and  capturing 
the  sometimes  vague  similarities  between  responses,  but  it  is  not 
as  rigorous  and  detailed  as  the  second  method,  which  is  based  on 
the  propositional  content  of  the  responses. 

The  first  step  in  the  propositional  analysis  method  was  to 
extract  the  propositions  expressed  in  each  response.  This 
propositionalization  was  done  along  lines  similar  to  Kintsch 
(1974)  and  Turner  and  Greene  (Note  1).  Then  for  each  passage  the 
different  predicates,  arguments,  and  propositions  were  determined 
by  means  of  a  program  written  in  the  LISP  language  that  tabulated 
the  individual  terms  and  propositions.  Due  to  the  great 
variation  in  specific  wording,  an  additional  step  in  the  analysis 
was  required  in  which  sets  of  synonymous  predicates  or  arguments 
were  replaced  with  single  terms.  Synonymous  terms  were  combined 
by  replacing  the  different  terms  with  a  single,  synthesized, 
term,  which  was  made  distinct  from  the  original  terms.  Then  a 
second  listing  was  done,  and  any  additional  synonymous  terms 
combined,  and  any  synonymous  propositions  or  combinations  of 
propositions  were  replaced  with  synthesized  propositions.  This 
reduced  set  of  propositionalized  responses  was  then  ready  for  the 
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actual  analysis. 

Due  to  the  many  subjective  judgments  required  in  this 
process,  care  was  taken  to  minimize  any  bias  effects  that  might 
influence  the  conclusions.  All  of  the  above  described  steps  were 
done  blind  with  regard  to  the  passage  version  associated  with  the 
response.  Only  after  these  steps  were  complete  were  the 
responses  separated  by  good  and  bad  passage  versions. 
Furthermore,  all  of  the  initial  propositionalization  of  the 
responses  was  done  independently  by  two  judges  who  then  resolved 
any  differences.  The  synonym  replacement  process  was  handled 
similarly  for  the  three  generalization  passages  and  the 
transportation  and  Jutland  passages.  A  single  judge  performed 
the  synonym  replacement  for  the  remaining  passages.  Finally,  the 
criterion  for  combining  synonymous  terms  was  fairly  conservative; 
hence  in  some  sense  the  analysis  shows  less  similarity  in  the 
responses  than  is  probably  really  there. 

The  analysis  of  the  propositionalized  responses  consisted  of 
examining  the  distribution  of  propositions  produced  for  each 
version  of  each  passage.  As  a  measure  of  the  typical  sets  of 
propositions,  a  LISP  program  was  used  to  identify  clusters  of 
propositions.  A  cluster  is  a  set  of  propositions  such  that  for 
more  than  one  response,  each  of  the  propositions  appears  in  each 
of  the  responses,  and  are  connected  either  by  shared  arguments  or 
by  embedding.  The  frequency  of  appearance  of  the  various 
clusters  gives  a  characterization  of  the  "central  tendency"  in 
the  content  of  the  responses.  The  program  used  the  following 
algorithm  for  finding  clusters:  First,  all  single  propositions 
occurring  in  more  than  one  response  were  collected.  Then  for 
each  of  these  base  propositions,  all  of  the  responses  were 
examined,  and  the  related  propositions,  those  connected  with  the 
base  proposition,  were  collected.  Then  each  possible  subset  of 
these  related  propositions  was  formed,  and  the  responses  scanned 
for  the  combination  of  the  base  proposition  and  the  subset  of 
related  propositions.  The  frequency  of  appearance  of  each  such 
combination  was  then  tabulated.  Examining  the  tabulation  allows 
one  to  assess  the  typical  response  content.  However,  since  the 
propositional  method,  as  currently  practiced,  tends  to  preserve 
some  of  the  specific  surface  form  of  the  response,  such  as  the 
embedding  relations  between  the  propositions,  the  results  from 
this  analysis  tend  to  reflect  not  just  similarities  in  response 
content,  but  also  in  response  structure  and  wording. 

Preliminary  examination  of  the  propositionalized  response 
tabulations  showed  no  systematic  differences  between  the  normal 
main  idea  task  and  the  sentence  rating  task.  Hence  the  response 
results  to  be  reported  are  based  on  the  full  64  subjects,  32  for 
each  passage  version. 
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Generalization  Passage  Results 


Metals .  The  metals  passage  is  shown  in  Table  1,  which  shows 
each  sentence  for  the  two  versions  and  the  mean  importance  rating 
for  each  sentence.  Where  a  sentence  did  not  appear  in  one  of  the 
versions,  there  is  no  importance  rating  shown  under  that  version. 
This  passage  was  intended  to  be  familiar  in  much  of  its  content. 
The  good  version  contained  an  initial  generalization  sentence, 
and  the  bad  version  was  obtained  by  replacing  the  initial 
generalization  with  a  specific  sentence.  Notice  that  the  bad 
version  thus  has  several  early  sentences  that  appear  to  group 
about  an  ancient  history  idea. 

The  mean  reading  times  were  50.9  secs  for  the  good  version 
and  57.4  secs  for  the  bad  version,  but  these  were  not 
significantly  different  ( t.  ( 30  )=  .  923  ,  £>.1).  This  suggests  that 
readers  found  the  bad  version  to  be  no  more  difficult  than  the 
good . 

The  intended  main  idea  sentence  received  the  unanimous  first 
choice  as  most  important,  and  as  shown  in  the  Table,  was 
significantly  more  important  than  the  first  sentence  in  the  bad 
version.  Notice  that  the  third,  fifth,  and  last  sentences  were 
judged  of  low  importance,  which  corresponds  roughly  to  the 
apparent  closeness  to  the  intended  main  idea. 

The  response  category  distributions  in  Table  2  for  the  two 
versions  were  significantly  different  ( XA2( b)= 10 . 900 ,  £< . 1) . 
Inspecting  the  table  shows  that  the  good  version  produced 
responses  that  essentially  echoed  the  intended  main  idea,  whereas 
the  bad  version  produced  a  different  main  idea,  but  one  of  equal 
apparent  quality.  Furthermore,  the  distribution  of  responses 
appears  to  be  equally  consistent  in  the  two  versions.  This  was 
shown  by  the  XA2  test  on  the  ordered  response  categories 
( XA2( 5)= 1  .3 ,  £>-9).  Thus  readers  of  the  bad  version  produced 
equally  consistent,  but  different,  responses  compared  to  the  good 
version  readers. 


The  results  of  the  propositional  analysis  of  the  responses 
are  shown  in  Table  3»  There  was  no  important  difference  in  the 
total  number  of  propositions  produced  for  the  two  versions  of 
this  passage,  or  for  any  of  the  passages.  However,  there  is  a 
suggestion  that  for  this  passage  there  are  more  different 
propositions  in  the  bad  version  responses,  and  more  sin gleton 
propositions.  These  are  propositions  which  appear  once,  in  only 
one  response.  However,  the  difference  was  not  significant, 
suggesting  that  readers  were  just  as  consistent  in  the  bad 
version  as  the  good.  Further  evidence  for  this  conclusion  is 
that  the  number  of  subjects  in  the  clusters  were  essentially 
identical  for  the  two  versions. 


The  cluster  groups  in  Table  3  are  English  representations  of 
the  propositions  making  up  the  clusters,  grouped  together  by 
apparent  content  for  simpler  presentation.  The  phrases  separated 
by  semicolons  are  separate  clusters.  Some  clusters  differed  only 
slightly;  these  are  combined  together,  with  the  alternate  forms 
indicated  by  the  bracketed  phrases. 


Table  1 

Passage  sentences  and  Mean  Importance  Ratings 
for  the  Metals  Passage 


Version 


Good  Bad  Sentence 

1 .0*  -  Different  metals  have  been  used  to  satisfy  the  needs  of 

various  cultures. 

-  2.8  Silver  was  used  until  quite  recently  in  the  United  States 

as  currency. 

2.6  3-7  Bronze  was  used  to  make  weapons  that  could  cut  through 

copper  shields  by  the  Hellenic  tribes  that  invaded  Greece 
long  before  the  Trojan  War. 

7.7  7.5  The  original  inhabitants  of  Greece  were  easily  overwhelmed 

by  the  land-hungry  invaders  because  of  their  poorer  weapons. 

3.7  4.1  Gold  was  valued  by  the  Incas  for  use  in  their  religious 

ceremonies  mainly  because  of  its  color. 

8.4  6.6*  However,  the  Spanish  conquest  of  the  Inca  Empire  was 

undertaken  because  the  Spanish  valued  gold  for  quite 
different  reasons. 

4.7  5.3  Aluminum,  which  is  light  in  weight  and  does  not  rust  or 

tarnish,  became  popular  in  the  Western  countries  for  camping 
and  backpacking  equipment. 

5.3  5.1  Titanium  is  essential  for  modern  industrial  nations  in  the 

manufacture  of  jet  airplanes  and  spacecraft. 

8.8  8.3  It  is  probably  most  familiar  in  the  brilliant  "Titanium 

White"  used  in  oil  paints  for  artists. 


*  Difference  between  mean  ratings  is  significant  at  .05  with  a 
2-tailed  t-test .  The  first  good  version  sentence  was  compared 
to  the  first  bad  version  sentence. 
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Table  2 

Response  Categories  and  Frequency  Distributions 
for  the  Metal s  Passage 

Version 

Good  Bad  Category 

15  5  cultures  used  metals  for  various  reasons 

9  15  metals  were  used  throughout  history  for  different  reasons 

2  6  the  uses,  or  importance,  of  metals 

2  3  specific  uses,  or  specific  metals 

3  2  miscellaneous  about  cultures  and  metals 
1 


0 


0  different  metals  and  different  places 
1  junk  response 
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Table  3 

Propositional  Analysis  for  the  Metals  Passage 


Version 

Good  Bad 

160 

168 

Total  Number  of  Propositions 

73 

84 

Different  Propositions 

49 

61 

Different  Singletons 

26 

22 

Subjects  In  Clusters 

Number  of  Subjects  Producing  Each  Cluster 


Version 


Good 

Bad 

Cluster  Description 

6 

2 

different  cultures  use  [different]  metals  [for 
different  purposes];  different  metals  meet  the  needs 
of  different  cultures;  uses  of  different  metals  in 
different  cultures 

4 

16 

[different]  metals  are  used  [in  different  ways, 
throughout  history,  for  [different]  reasons, 
worldwide,  for  a  use];  metals  are  used  and  valued; 
different  metals  are  valued  for  different  reasons; 
mankind  used  metals  throughout  history 

8 

7 

[many]  [different]  uses  [and  values]  of  [precious] 
metals  [throughout  history];  [different]  metals  are 
important  [for  different  reasons];  uses  of  metals 
change 

6 

0 

in  different  cultures;  needs  of  different  cultures; 
to  different  cultures 

5 

2 

for  [many]  different  reasons;  in  different  places 
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The  first  group  of  clusters  shown  is  very  similar  to  the 
generalization  sentence,  being  about  how  cultures  used  metals. 
Most  of  the  subjects  producing  such  responses  were  ones  reading 
the  good  version,  but  the  difference  was  not  significant 
( XA2 ( 1 )=2 . 286 ,£< . 1 ) .  In  addition,  more  good  version  subjects 
used  the  propositions  about  cultures  shown  in  the  ^urth  cluster 
group  ( X~2( 1 )=6 . 621 ,£< . 02 ) .  More  bad  version  subjects  than  good 
version  subjects  produced  responses  in  the  second  group  about 
metals  being  used  for  various  purposes  or  throughout  history 
( X“2( 1 )= 10. 473,  o< .01 ) .  This  group  appears  to  contain  clusters 
wEose  quality  as  main  ideas  is  as  high  as  the  first  group.  Equal 
numbers  of  subjects  mentioned  the  uses  or  importance  of  metals, 
or  miscellaneous  differences. 


Thus  in  summary,  the  metals  passage  was  familiar  and  clear 
enough  to  readers  that  they  were  able  to  abstract  its  main  idea 
fairly  successfully  regardless  of  whether  or  not  the  main  idea 
was  explicitly  stated.  The  main  idea  implied  by  the  bad  version 
was  somewhat  different  from  the  one  stated  in  good  version,  but 
the  ease  of  abstracting  the  implicit  main  idea,  and  the 
consistency  of  it  across  subjects,  matched  that  when  the  main 
idea  was  explicit. 


Timekeeping.  The  timekeeping  passage  shown  in  Table  4  is 
similiar  in  construction  to  metals ,  and  is  less  familiar  than 
metals  in  content,  but  still  deals  with  some  familiar  objects. 


The  mean  reading  time  for  the  good  version  was  similar  to 
that  of  metals,  52.1  secs,  but  the  bad  version  time  was  much 
longer,  at  81.3  secs  ( t  (  30  )  =  2 .437  ,  £<.05).  Apparently  the  bad 
version  was  much  harder  to  work  with  than  the  good. 


As  in  metals,  the  intended  main  idea  sentence,  the  first 
sentence  of  the  good  version,  was  the  unanimous  first  choice  for 
the  most  important  sentence.  Notice  that  the  third  and  fifth 
sentences  are  judged  of  low  importance,  again  because  they  are 
relatively  unrelated  to  the  main  idea.  Notice  that  the  last 
sentence  is  judged  more  important  in  the  bad  version  than  in  the 
good;  apparently  there  is  some  tendency  to  view  this  sentence  as 
a  concluding  statement  of  some  sort,  as  if  the  passage  was 
presenting  the  development  that  led  up  to  the  hydrogen  maser 
clock.  A  similar  development-climax  pattern  appears  in  other 
passages  to  be  described. 


two 
Moreover , 
di fferent 
responses 
is  clear 
idea,  but 
t  ending 


The  response  category  distributions  shown  in  Table  5  for  the 
versions  were  very  different  ( X*2( 7)=24 . 189 ,  £< .01). 

the  ordered  frequency  distributions  were  also  rather 
( X*2( 7)= 1 4 . 076 ,  £< . 05 ) ,  showing  that  the  bad  version 

were  less  consistent  than  the  good.  From  the  Table,  it 
that  most  good  version  readers  echoed  the  intended  main 
bad  version  readers  produced  a  variety  of  responses, 
to  group  around  the  notion  that  timepieces  vary  in 


accuracy.  Some  bad 
intended  main  idea. 


version  readers,  however,  did  produce  the 
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Table  4 

Passage  sentences  and  Mean  Importance  Ratings 
for  the  Timekeeping  Passage 


Version 


Good  Bad  Sentence 


1 .0*  —  Modern  timekeeping  devices  are  extremely  accurate. 

-  3.4  An  ordinary  digital  alarm  clock  will  be  correct  within  a 

second  per  day. 

4.9  3.6  An  inexpensive  quartz-crystal  watch,  now  being  sold  for 

less  than  ten  dollars,  will  stay  accurate  to  a  few  seconds 
per  week. 

6.4  5.7  Greater  accuracy  can  be  achieved  with  proper  adjustment. 

4.2  3*9  An  atomic  resonance  clock  is  precise  to  a  millionth  of  a 

second  over  several  years. 

6.0  5.8  A  portable  one  was  used  to  measure  the  tiny  time 

distortions  predicted  by  Einstein's  theory  that  would  be 
produced  by  taking  an  around-the-world  trip  by  commercial 
airliner. 

4.4  2.5*  The  hydrogen  maser  master  clocks  now  used  by  the  National 

Bureau  of  Standards  are  sophisticated  precision  instruments 
that  gain  or  lose  less  than  one  second  over  10  million  years 


*  Difference  between  mean  ratings  is  significant  at  .05  with 
a  2-tailed  t-test.  The  first  good  version  sentence  was  compared 
to  the  first  bad  version  sentence. 


Table  5 

Response  Categories  and  Frequency  Distributions 
for  the  Timekeeping  Passage 

Version 

Good  Bad  Category 

24  7  modern  timekeeping  devices  are  accurate 

2  2  timekeeping  devices  are  accurate 

0  10  different  clocks  have  different  accuracies 

2  2  specific  device,  or  specific  accuracy 

0  4  the  more  complex  the  clock,  the  more  accurate 

1  2  specific  ways  to  make  a  clock  more  accurate 

2  3  technology  has  produced  better  clocks 

1  2  miscellaneous 


Ki eras 


Page  13 


The  propositional  analysis,  shown  in  Table  6,  agrees  with 
the  above  results  to  some  extent.  The  apparent  difference 
between  versions  in  the  number  of  different  propositions  and  the 
number  of  singletons  is  not  significant  (£s>.2),  and  likewise 
there  is  no  difference  to  be  seen  in  the  cluster  analysis. 
However,  the  qualitative  difference  in  the  cluster  content 
corresponds  closely  to  the  reponse  categories  already  described. 
In  the  timekeeping  passage,  there  were  two  major  groups  of 
structures,  both  about  the  idea  that  timekeeping  devices  are 
accurate,  but  the  first  group  includes  a  modifier  that  today ' s 
devices  are  accurate.  Thus  readers  of  both  versions  used  similar 
propositions,  but  more  good  version  readers  than  bad  version 
picked  up  the  modern  modification  of  timekeeping  devices 
( X*2(  1  )= 18 .6  18  ,  £< .001 ) .  More  bad  version  readers  than  good  used 
tfie  idea  of  accurate  timekeeping  devices  without  the  modern 
modification  ( X~2( 1 )  =  3 • 473 ,  .1>£>.05).  Another  feature  is  that 
only  bad  version  readers  used  propositions  stating  a  comparison 
between  timekeeping  devices  ( X* 2(  1  )= 10 . 473 >  £<.01). 

Thus  the  timekeeping  passage  differs  from  metals  in  that  the 
good  version  produces  highly  consistent  responses  that  echo  the 
intended  main  idea  in  a  small  amount  of  reading  time,  but  the  bad 
version  produces  a  great  variety  of  responses,  and  takes 
considerably  longer  to  read.  This  difference  can  be  attributed 
to  the  lower  familiarity  of  the  technical  concepts  in  the 
passage,  compared  to  metals,  rather  than  to  any  other  differences 
such  as  the  logical  structure  of  the  passage,  since  timekeeping 
seems  simpler  in  structure  than  metals.  However,  readers  could 
have  tried  to  construct  a  main  idea  around  the  apparent 
sequence-climax  structure  of  the  bad  version,  failed  to  do  so 
satisfactorily,  and  settled  for  haphazardly  chosen  other  ideas. 

Instruments .  This  passage,  shown  in  Table  7,  is  rather 
unfamiliar  in  subject  matter,  and  the  intended  main  idea  sentence 
is  also  rather  complex.  The  bad  version  was  obtained  by  deleting 
the  intended  generalization  sentence  and  inserting  a  new  third 
sentence . 

The  reading  time  for  the  good  version  was  longer  than  that 
for  metals  and  timekeeping,  being  65.6  seconds,  and  very  long  for 
the  bad  version'^  89.9  seconds  ( t ( 30  )  =  2 .579 >  £<.05).  Hence  the 
good  version  was  more  difficult  than  the  more  familiar  passages, 
but  the  bad  version  was  as  difficult  as  the  bad  version  of 
timekeeping . 

Despite  the  unfamiliarity  and  difficulty  of  this  passage, 
the  intended  main  idea  sentence  was  still  the  unanimous  first 
choice  for  the  most  importance  sentence.  Notice  however,  that  in 
the  good  version,  all  of  the  other  sentences  are  of  roughly  equal 
importance,  which  is  reasonable  given  the  intended  main  idea. 
Thus  the  difficulty  of  the  good  version  compared  to  the  other 
passages  could  be  due  in  part  to  there  simply  being  more 
information  to  be  considered.  In  the  bad  version,  notice  that 
the  third  sentence,  the  added  filler,  is  dismissed  as  irrelevant, 
and  the  last  sentence  is  the  most  important.  This  suggests  that 
readers  viewed  the  bad  version  as  having  a  sequence-climax 
structure . 
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Table  6 

Propositional  Analysis  for  the  Timekeep ing  Passage 


Version 


Good 

Bad 

174 

176 

Total  Number  of  Propositions 

65 

83 

Different  Propositions 

44 

51 

Different  Singletons 

27 

26 

Subjects  In  Clusters 

Number  of  Subjects  Producing  Each  Cluster 


Version 


Good  Bad  Cluster  Description 


18  2  very  accurate  modern  timekeeping  devices;  [many] 

timekeeping  devices  are  [very]  accurate  today; 
modern  timekeeping  devices  achieve  accuracy; 
accurate  timekeeping  devices  exist  today;  modern 
timekeeping  devices  achieve  much  accuracy;  modern 
clocks  and  watches  are  very  accurate;  today 
timekeeping  devices  exist  that  have  accuracy  that  is 
ultraprecise  over  millions  of  years 


7  14  [very]  accurate  timekeeping  devices;  very  accurate 

clocks;  timekeeping  devices  achieve  [more]  accuracy; 
accuracy  of  timekeeping  devices;  man  devised  [very] 
accurate  timekeeping  devices;  time  is  kept 
accurately;  devices  range  in  accuracy  from  precise 
to  ultraprecise;  very  accurate  timekeeping  devices 
are  available 


4  2  modern  timekeeping  devices;  man’s  timekeeping 

devices;  more  sophisticated  timekeeping  devices 

0  9  some  [timekeeping]  devices  are  more  accurate  than 

other  [timekeeping  devices];  different  timekeeping 
devices  vary  in  their  accuracy;  different 
timekeeping  devices  have  different  degrees  of 
accuracy 

2  1  over  millions  of  years 
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Table  7 

Passage  sentences  and  Mean  Importance  Ratings 
for  the  Instrume nts  Passage 


Version 


Good  Bad  Sentence 


1.0*  -  The  mechanics  of  keyboard  instruments  differ  in  what  they 

allow  the  performer  to  control. 

4.9  3-7  In  the  oldest  keyboard  instrument,  the  clavichord,  a  small 

metal  hammer  at  the  end  of  the  key  strikes  the  string  which 
then  vibrates  between  the  hammer  and  the  bridge. 

5-3  4.6  Since  the  key  is  in  direct  contact  with  the  string,  the 

player  is  able  to  control  its  pitch. 

-  7.1  This  feature,  together  with  its  clear  sound,  made  the 

clavichord  a  favorite  for  many  years. 

5.8  5.3  In  the  harpsichord,  pressing  the  key  causes  a  small  stiff 

finger,  the  plectrum,  to  pluck  the  string. 

5.1  5.9  Since  the  plectrum  always  moves  the  same  distance,  the 

performer  can  not  control  the  loudness  of  the  tone  produced 

6.7  6.2  Finally,  in  the  piano,  the  mechanism  throws  the  hammer 

against  the  string. 

6.7  5.5  The  force  with  which  the  hammer  strikes  depends  on  how  hard 

the  key  is  struck. 

6.2  3.4*  This  enables  the  piano  performer  to  control  the  loudness  of 

the  music  for  each  individual  note,  thereby  achieving  a 
degree  of  expressiveness  not  possible  on  the  earlier 
instruments . 


*  Difference  between  mean  ratings  is  significant  at  .05  with  a 
2-tailed  t-test.  The  first  good  version  sentence  was  compared 
to  the  first  bad  version  sentence. 
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The  response  categories  shown  in  Table  8  were  different  for 
the  two  versions  ( X~2( 9) =21 . 377 ,  pC.01),  and  the  bad  version 
distribution  appears  somewhat  more  consistent  than  the  good,  but 
is  not  significantly  so  according  to  the  ordered  frequency  test 
( X~2( 8)  =  4 .861  ,  £>.70).  The  most  remarkable  feature  of  the 
responses  is  how  few  captured  the  intended  main  idea;  only  seven 
good  version  readers  came  close,  with  eleven  others  picking  up 
fragments  based  on  the  notion  of  differences.  Perhaps  the 
apparent  poor  quality  of  the  responses  is  due  to  the  complexity 
of  the  intended  main  idea;  the  subjects  simply  may  have  had 
trouble  phrasing  their  response  to  fit  into  the  length 
restrictions.  On  the  other  hand,  many  of  the  bad  version  readers 
organized  the  passage  around  a  specific  instrument,  the  piano, 
and  appeared  to  organize  the  passsage  around  a  sequence-climax 
form  of  the  development  of  the  piano.  Given  the  familiarity  of 
the  piano  relative  to  the  other  instruments,  and  the 
unfamiliarity  of  keyboard  instruments  as  a  concept,  the 
superiority  of  the  piano  could  have  been  the  only  general  idea 
available  to  the  subjects.  Notice  how  many  of  the  bad  version 
readers  failed  to  generalize,  but  instead  focussed  on  specific 
instruments  or  their  properties. 

The  propositional  analysis  shown  in  Table  9  highlights  the 
problems  with  instruments  dramatically.  Although  the  total 
number  of  propositions  is  comparable  to  timekeeping,  the  number 
of  different  propositions  is  much  greater.  The  number  of 
singleton  propositions  is  also  much  greater,  both  in  comparison 
to  metals  ( X~2( 1 )=50 . 533 ,  pC.001),  and  timekeeping 
(X~2(  1)  =  80. 162,  £<.001 ).  The  number  of  clusters  in  instruments 
is  also  considerably  fewer  than  in  the  others.  Although  such 
comparisons  are  contaminated  by  possible  differences  in  the 
propositional  analysis  process  itself,  it  is  a  strong  suggestion 
that  the  instruments  passage  produced  response  that  were  much 
less  consistent  on  the  whole  than  in  the  more  familiar  passages. 

The  different  versions  produced  differences  in  the 
propositional  content  of  the  responses.  As  shown  in  Table  9,  the 
number  of  singletons  was  greater  in  the  bad  version  than  in  the 
good  (X~2( 1 )=5 .750 ,  £<.05).  The  number  of  subjects  participating 
in  the  clusters  was  grossly  fewer  in  the  bad  version 
( X~2( 1  )  = 1 4 . 769  ,  p< . 00 1 ) .  Since  there  are  so  few  clusters,  their 
content  does  not  characterize  the  typical  response  very  well. 
However,  notice  that  more  good  version  readers  produced  responses 
using  the  idea  of  the  mechanism  of  keyboard  instruments 
( X~2( i )=4 . 267 ,  £< • 05 ) ,  or  of  differences  in  keyboard  instruments 
( X“2(  1 )  =  1 6 . 31 4 ,  £<.001 ) .  Notably,  one  of  the  two  clusters 
produced  in  the  bad  version  was  rather  specific,  about  the  piano. 

Thus,  the  instruments  passage,  being  rather  unfamiliar  and 
complex,  suffered  disastrous  effects  in  the  bad  version.  The 
passage  took  a  long  time  to  read,  the  consistency  of  the 
responses  was  poor  overall,  and  most  subjects  failed  to  get  the 
point,  even  when  it  was  explicitly  stated.  But  the  propositional 
analysis  shows  that  the  presence  of  the  main  idea  sentence  helps 
guide  some  of  the  content  of  the  responses,  so  that  more  good 
version  readers  shared  a  core  of  propositions  than  bad  version 
readers.  In  spite  of  the  problems  readers  had  with  the  passage, 
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Table  8 

Response  Categories  and  Frequency  Distributions 
for  the  Instruments  Passage 


Version 

Good  Bad  Category 

7  ^  difference  in  mechanisms  means  a  difference  in  sound  or 

what  the  performer  can  control 

5  0  difference  in  control 

3  0  difference  in  mechanisms 

3  0  difference  in  instruments 

5  12  the  piano  is  superior  to,  or  culmination  of,  the  other 

keyboard  instruments 

0  6  specific  instruments  and  differences 

2  2  specific  qualities  or  means  of  control 

1  2  mechanisms  of  keyboard  instruments 

2  3  musical  instruments  in  general 

4  3  instruments  have  evolved 
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Table  9 

Propositional  Analysis  for  the  Instruments  Passage 


Version 


Good 

Bad 

1  66 

164 

Total  Number  of  Propositions 

110 

129 

Different  Propositions 

91 

1 1 1 

Different  Singletons 

20 

5 

Subjects  In  Clusters 

Number  of  Subjects  Producing  Each  Cluster 

Version 

Good 

Bad 

Cluster  Description 

8 

2 

mechanisms  of  [different]  keyboard  instruments 

13 

0 

different  keyboard  instruments;  keyboard  instruments 
differ  in  something;  earlier  keyboard  instruments; 
modern  and  old  keyboard  instruments 

2 

0 

the  performer  controls  keyboard  instruments; 

0 

3 

the  piano  is  a  keyboard  instrument 
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they  could  still  single  out  as  most  important  the  explicit  main 
idea  in  the  good  version,  and  dismiss  an  irrelevant  detail  even 
in  the  bad  version. 

Construction  Passage  Results 

Transportation .  The  t ransportati on  passage,  shown  in  Table 
10,  resembles  a  generalization  passage,  but  the  logical  relation 
between  the  intended  main  idea  and  the  passage  is  ncc  that  of 
generalization,  but  rather  that  of  of  an  assertion  supported  by 
specific  facts.  The  bad  version  of  this  passage  was  prepared  by 
deleting  the  initial  statement  of  the  intended  main  idea  and 
adding  another  sentence  to  the  end. 


The  r 
s  ignif ican 
that  this 
ge  nera li za 
passages  , 
not  the 
This  patte 
their  ma 
p  assages . 
about  cars 
s  entence . 


eading  time  for 
tly,  being  53*9 
is  as  fast 
tion  passages, 
the  initial  main 
unanimous  first 
rn  suggests  that 
crostr uctural 
Notice  that  in 
being  accessibl 


the  good  and  bad  ver 
secs  and  55.4  secs 
as  the  metals  p  as 
and  like  the 
idea  sentence  in  th 
choice  for  the  most 
these  passages  are 
properties  than 
the  bad  version,  the 
e  and  convenient,  is 


sion  did  not  differ 
respectively.  Note 
sage.  Unlike  the 
other  construction 
e  good  version  was 
important  sentence, 
rather  different  in 
the  generalization 
second  sentence, 
the  most  important 


The  response  category  distributions,  shown  in  Table  11,  are 
marginally  different  ( X~2( 10 )= 1 4 . 663 ,  .2>p>.1),  and  similarly 
consistent  ( X" 2 ( 9) = 1 .577 ,  £>.99)*  The  most  popular  response  in 
both  versions  corresponds  closely  to  the  intended  main  idea.  In 
the  good  version,  there  was  some  tendency  for  more  subjects  to 
use  the  idea  of  popularity  from  the  intended  main  idea  than  in 
the  bad  version,  where  more  subjects  picked  up  the  convenience 
notion  from  the  most  important  sentence  in  that  version. 

The  quantitative  measures  from  the  propositional  analysis, 
shown  in  Table  12,  show  no  difference  between  versions  in  the 
consistency  of  the  responses;  overall  the  numbers  are  comparable 
to  those  of  the  familiar  metals  passage.  The  content  of  the 
important  clusters  corresponds  closely  with  the  response  category 
results.  Equal  number  of  subjects  in  both  versions  used  the  idea 
that  cars  were  popular. 

Thus,  like  the  familiar  metals  passage,  the  transportati on 
passage  produced  responses  in  both  version  that  were  either 
identical  or  equal  in  quality,  with  no  difference  in  the  time 
required.  Unlike  the  generalization  passages,  however,  the 
relative  importance  of  the  explicit  main  idea  sentence  was  not  as 
pronounced  . 

Watergate .  The  Watergate  passage,  shown  in  Table  13,  deals 
with  subject  matter  that  is  very  familiar  in  general  terms,  but 
contains  many  specific  facts,  all  of  which,  incidentally,  are 
based  strictly  on  the  public  record.  The  good  version  contains 
an  initial  statement  of  the  main  idea  that  Nixon  resigned  because 
of  Watergate.  The  last  sentence  repeats  that  Nixon  resigned,  but 
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Table  10 

Passage  sentences  and  Kean  Importance  Ratings 
for  the  Transportation  Passage 


Version 


Good  Bad  Sentence 


2.3  -  The  car  is  by  far  the  most  popular  form  of  transportation 

in  the  United  States  today. 

3.8  3-2  Cars  are  a  less  economical  form  of  transportation  than  the 

bus  but  people  prefer  to  use  their  cars  most  of  the  time 
because  they  find  buses  inconvenient  and  slow. 

5.0  2.6*  Cars  are  accessible  and  convenient  whether  only  for  a  trip 

to  the  store  or  across  country. 

5.1  4.8  Although  trains  were  once  very  popular,  today  most  train 

services  operate  at  a  loss,  while  there  are  more  cars  on  the 
road  than  ever. 

7.3  6.7  Railbeds  and  rolling  stock  fall  into  disrepair  through 

money  shortages  but  new  highways  are  built  every  month,  at  a 
cost  of  millions  of  dollars. 

6.3  5.8  Though  the  speed  of  aircraft  makes  them  attractive  and 

glamorous,  they  are  a  very  expensive  way  to  travel. 

5.8  6.5  This  means  that  most  people  use  them  only  occasionally  for 

long  distance  travel  preferring  their  cars  for  more  routine, 
shorter  trips. 

-  5.4  The  rise  of  gasoline  prices  has  made  the  bicycle  more 

popular,  though  it  still  is  not  a  major  form  of 
transportation . 


*  Difference  between  mean  ratings  is  significant  at  .05  with  a 
2-tailed  t-test.  The  first  good  version  sentence  was  compared 
to  the  first  bad  version  sentence. 
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Table  11 

Response  Categories  and  Frequency  Distributions 
for  the  Transportation  Passage 


Version 

Good 

Bad 

Category 

12 

1 1 

the  car 

is 

the  most  popular  or  most  preferred 

5 

0 

the  car 

is 

more  popular  than  a  specific  other  means 

4 

0 

the  car 

is 

more  popular  for  a  specific  use 

2 

5 

the  car 

is 

popular  because  it  is  convenient 

1 

1 

the  car 
is  not 

is  popular  because  it  is  convenient,  but  it 
economical 

3 

3 

the  car 

is 

popular,  but  not  economical 

0 

2 

the  car 

is 

convenient 

1 

2 

the  car 

is 

convenient,  but  not  economical 

1 

4 

other  advantages  of  cars 

2 

3 

general 

remarks  about  transportation 

1 

1 

general 

remarks  about  cars 
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Table  12 

Propositional  Analysis  for  the  Transportation  Passage 

Version 


Good 

Bad 

176 

172 

Total  Number  of  Propositions 

31 

82 

Different  Propositions 

54 

59 

Different  Singletons 

24 

21 

Subjects  In  Clusters 

Number  of  Subjects  Producing  Each  Cluster 


Version 


Good 

Bad 

Cluster  Description 

10 

10 

the  car  is 
[in  the  U.S 

the  [most]  popular  form  of  transportation 
.  [today]];  the  car  is  most  popular 

3 

5 

the  car  is  more  convenient;  the  car  is  the 
convenient  form  of  transportation;  because  the  car 
is  convenient  people  use  cars;  people  use  convenient 
cars 

5 

6 

the  car  is 
the  U.S.] ; 
prefer  the 

[still]  the  form  of  transportation  [in 
although  the  car  is  economical;  people 
car  to  other  forms  of  transportation 

7 

2 

economical  form  of  transportation;  over  other  forms; 
cars  buses  trains  and  airplanes  are  used;  other 
forms  of  transportation 
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Table  13 

Passage  sentences  and  Mean  Importance  Ratings 
for  the  Watergate  Passage 


Vers  ion 


Good 

Gad 

Sentence 

3.1 

— 

The  affair  known  as  Watergate  caused  Nixon  to  resign  from 
the  presidency. 

5.5 

3.0* 

On  June  17,  1972,  five  men  were  arrested  for  illegally 
entering  the  offices  of  the  Democratic  National  Committee  at 
the  Watergate  building  in  Washington  D.  C. 

— 

6.3 

One  of  them  was  James  McCord,  who  was  head  of  security 
the  Committee  to  Re-elect  the  President. 

for 

4.9 

4.4 

In  subsequent  investigations  by  the  House,  Senate,  and  the 
Special  Prosecutor,  more  than  30  Nixon  administration 
officials,  campaign  officials,  and  financial  contributors 
were  found  guilty  of  breaking  the  law. 

4.1 

3.6 

Tapes  of  White  House  conversations  implicated  Nixon 
himself. 

5.9 

7.2* 

A  House  committee  voted  in  favor  of  several  articles  of 
impeachment . 

3.3 

5.2* 

The  charges  against  him  were  that  he  obstructed  justice 
the  Watergate  break-in,  that  he  had  not  obeyed  House 
subpoenas,  and  that  he  had  misused  his  authority  in 
activities  such  as  wiretapping. 

in 

5.1 

3.6 

On  August  9,  1974,  Nixon  resigned  from  the  presidency. 

*  Difference  between  mean  ratings  is  significant  at  .05  with  a 
2-tailed  t-test.  The  first  good  version  sentence  was  compared 
to  the  first  bad  version  sentence. 
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nowhere  else  in  the  passage  is  the  causal  connection  between 
Watergate  and  the  resignation  explicitly  stated.  The  bad  version 
was  prepared  by  deleting  the  first  sentence  and  inserting  a 
detail  sentence  as  the  second  sentence.  The  sentence  that 
appeared  first  in  the  bad  version  was  chosen  so  that  it  could 
stand  as  an  initial  sentence. 

The  reading  time  for  the  bad  version,  57*2  secs,  was 
somewhat  longer  than  the  time  for  the  good  version,  47.1  secs, 
and  the  difference  was  marginally  significant  ( t ( 30 )= 1  . 376 , 
1-tail  £< . 1 ) . 

Notice  that  the  intended  main  idea  sentence  in  the  good 
version  is  only  slightly  more  important  than  the  next-to-the-last 
sentence  which  states  the  charges  against  Nixon.  Hence  in  this 
passage  as  well,  the  explicit  statement  of  the  main  idea  does  not 
have  the  prominence  it  has  in  the  generalization  passages. 
Further  differences  in  the  important  ratings  appeared.  The  first 
and  sixth  sentences  are  significantly  more  important  in  the  good 
than  in  the  bad  version,  but  the  last  sentence  goes  the  opposite 
way.  Apparently,  the  intended  main  idea  sentences  directed  the 
reader's  attention  to  the  impeachment  activities  again  Nixon,  but 
rendered  the  last  sentence  redundant.  But  in  the  bad  version, 
the  passage  appears  to  be  leading  up  to  the  conclusion  of  Nixon's 
resignation.  The  chain  of  events  involved  would  make  the  first 
and  the  last  sentences  stand  out. 

Despite  the  clear  differences  in  processing  the  two  versions 
that  are  implied  by  the  reading  times  and  the  importance  ratings, 
the  response  categories,  shown  in  Table  14,  are  remarkably 
similar,  differing  neither  in  distribution  ( X~2( 5)= .926 ,  £>.98) 
nor  in  consistency  ( X~2( 5)= . 926 ,  £>.98).  In  both  versions,  the 
most  popular  response  category  was  essentially  the  intended  main 
idea.  Perhaps  due  to  the  controversial  or  notorious  nature  of 
the  passage  content,  a  small  but  noticeable  number  of  readers 
stated  that  Nixon  broke  the  law,  which  was  not  stated  by  the 
passage,  or  produced  "editorials"  about  the  corruption  of 
poli tici ans . 

The  propositional  analysis  shown  in  Table  15  yielded  a  large 
number  of  singletons  compared  to  transportation ,  and  few 
clusters,  or  subjects  participating  in  them.  Although  the  number 
of  singletons  produced  by  the  two  versions  is  the  same,  there  are 
actually  more  subjects  participating  in  clusters  in  the  bad 
version  than  in  the  good. 

The  content  of  the  clusters  clarifies  this  counter-intuitive 
result.  Identical  numbers  of  subjects  used  the  intended  main 
idea.  A  few  more  bad  version  readers  than  good  used  an  idea 
about  Nixon  resigning  after  something,  or  that  various  events  led 
to  the  resignation.  Finally,  a  few  more  subjects  produced 
miscellaneous  fragments  that  happened  to  appear  in  more  than  one 
response.  Hence  the  clusters  that  actually  contain  substantive 
propositions  show  little  or  no  difference  between  versions. 
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Table  14 

Response  Categories  and  Frequency  Distributions 
for  the  Watergate  Passage 


Version 


Good 

Bad 

Category 

13 

12 

Nixon 

resigned  because  of  Watergate 

6 

4 

Nixon 

resigned  because  of  other  illegal  events 

6 

8 

Nixon 

or  his  administration  broke  the  law  or  was  guilty 

2 

2 

Nixon 

re  si  gned 

2 

3 

Editorial  remarks 

3 

3 

Miscellaneous 

Table  15 

Propositional  Analysis  for  the  Watergate  Passage 

Version 

Good  Bad 

129  138  Total  Number  of  Propositions 

89  91  Different  Propositions 

72  76  Different  Singletons 

9  14  Subjects  In  Clusters 

Number  of  Subjects  Producing  Each  Cluster 

Vers  ion 

Good  Bad  Cluster  Description 

5  5  [President]  Nixon  resigned  from  the  presidency 

because  of  Watergate  [affair];  the  Watergate 
[affair,  breakin]  lead  to  [President]  Nixon 
resigning  from  the  presidency. 

2  5  [implications,  events]  lead  to  [President]  Nixon 

resigning  from  the  presidency;  after  something 
[President]  Nixon  resigned  from  the  presidency 

2  1  in  the  Watergate  affair;  because  of  the  Watergate 

affair 

0  2  President  Nixon  broke  the  law 

0  2  many  of  Nixon's  officials 
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Thus,  the  Watergate  passage,  with  its  familar  topic  but 
unfamiliar  details,  showed  version  effects  on  what  the  readers 
considered  and  how  long  they  took  to  read,  but  no  version  effects 
on  what  was  contained  in  the  responses.  Although  it  was  read 
quickly,  there  were  substantial  inconsistencies  in  the  specific 
content  of  the  responses;  few  subjects  participated  in  the 
c lusters . 

Jutland .  The  Jutland  passage,  shown  in  Table  16,  is 
comparable  to  instruments  in  that  it  is  about  rather  unfamiliar 
subject  matter  and  contains  several  unfamiliar  technical  terms. 
The  bad  version  was  prepared  by  replacing  the  intended  main  idea 
sentence  with  one  that  performed  the  same  function  of  introducing 
the  name  of  the  battle  and  the  two  forces  involved,  but  did  not 
say  anything  about  the  outcome.  The  second  sentence  was  then 
lengthened  somewhat  to  yield  the  same  passage  length  as  the  good 
version.  Notice  that  to  the  naval  history  novice,  the  passage 
may  be  puzzling,  especially  in  the  bad  version,  because  the 
outcome  of  the  battle  is  not  at  all  clear;  it  is  not  obvious  who 
came  out  on  top  and  why. 

The  reading  time  for  the  good  version  was  90.1  secs,  for  the 
bad  version,  88.6  secs.  The  difference  is  in  the  wrong 
direction,  but  fails  to  approach  significance  ( t(30)= . 108) .  This 
large  reading  time,  comparable  to  that  for  the  bad  version  of  the 
unfamiliar  instruments  passage,  means  that  readers  had  a 
difficult  time  with  this  passage.  Notice  that  the  passage  is 
written  in  a  relatively  plain  literary  style,  suggesting  that  the 
long  reading  time  is  a  function  of  the  content,  not  of  difficult 
construction . 

The  initial  intended  main  idea  sentence  was  rated  as  highly 
important,  but  not  unanimously  so;  subjects  failed  to  give  it 
the  first  rank.  This  prominence  of  the  main  idea  sentence 
resembles  the  generalization  passages  more  than  the  other 
construction  passages.  However,  notice  that  the  first  sentence 
of  the  bad  version  also  is  very  important,  which  argues  that  it 
is  not  the  specific  content  of  the  intended  main  idea  sentence 
which  produces  its  high  rating,  but  rather  the  structure  of  the 
passage  as  a  whole.  Perhaps  this  structure  is  in  the  form  of  an 
introduction  followed  by  a  sequence,  rather  than  a 
conclusion-argument  form.  But  it  is  a  puzzle  why  the  readers 
gave  little  importance  to  the  last  two  sentence  summarizing  the 
outcome  of  the  battle.  Instead,  they  considered  the  fourth  and 
fifth  sentences  important,  perhaps  because  they  contain  the 
climax  of  the  battle.  Finally,  notice  that  the  second  sentence 
is  dismissed  in  the  good  version,  where  it  is  just  a  transition, 
but  is  considered  fairly  .important  in  the  bad  version,  where  it 
initiates  the  narrative  sequence  anticipated  by  the  first 
sentence . 

The  distribution  of  the  response  categories,  shown  in  Table 
17,  were  different  ( X*2( 8)= 1 4 . 303 ,  p< .  1 ) ,  and  the  consistency  was 
the  same  ( X*2(7)= .725 ,  £>.98).  The  most  striking  feature  of  the 
responses  is  how  few  subjects  produced  the  idea  that  although  the 
British  won,  there  was  a  qualification  to  their  victory.  In  the 
good  version,  only  seven  subjects  in  two  categories  did  so,  in 


Table  16 

Passage  sentences  and  Mean  Importance  Ratings 
for  the  Jutland  Passage 


Version 


Good  Bad  Sentence 


1.2  -  In  the  World  War  I  Battle  of  Jutland,  although  the  British 

navy  failed  to  destroy  the  German  fleet,  they  won  a  major 
strategic  victory. 

-  1.9  The  World  War  I  Battle  of  Jutland  was  an  encounter  between 

the  British  Grand  Fleet  and  the  German  High  Seas  Fleet. 

5.9  -  The  battle  began  when  the  battle  cruiser  scouting  forces  of 

the  two  fleets  sighted  each  other  and  opened  fire. 

-  4.7  The  battle  began  when  the  battle  cruiser  divisions,  acting 

as  scouting  forces  for  the  two  fleets,  sighted  each  other  and 
opened  fire. 

6.6  6.0  The  fleets  grew  closer  together  in  the  mists  of  the  North 

Sea,  until  finally  the  main  battleship  groups  encountered 
each  other. 

4.3  4.7  The  British  attained  a  greatly  superior  position,  the 

decisive  "crossing-the-T. " 

4.3  5.1  But  the  Germans  had  practiced  evading  superior  forces,  and 

so  carried  out  a  superb  "battle  turn  away  together"  that  was 
not  even  in  the  British  maneuvers  book,  and  so  escaped  the 
trap . 

5.6  6.1  But  in  the  meantime,  the  British  lost  three  battle 

cruisers,  and  the  Germans  lost  one  obsolete  battleship. 

5.8  5.8  The  German  fleet  never  again  left  harbor  except  to 

surrender . 


Jfote:  None  of  the  comparisons  of  ratings  between  corresponding 
sentences  in  the  two  versions  were  significant. 
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Table  17 

Response  Categories  and  Frequency  Distributions 
for  the  Jutland  Passage 

Version 

Good  Bad  Category 

7  7  unqualified  British  victory 

3  1  tactical  failure,  but  strategic  victory  for  British 

4  0  qualified  British  victory 

1  3  German  failure 

9  8  German  success,  qualified  success,  successful  escape 

1  4  battle  involved  British  and  Germans 

2  7  neutral  commentary  about  both  forces  in  the  battle 

5  1  the  battle  was  important 


0  1 


junk  response 
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the  bad  version  only  one.  Seven  other  subjects  in  each  version 
stated  that  the  battle  was  an  unqualified  British  victory,  but 
more  subjects  stated  that  it  was  a  success  for  the  Germans.  The 
difference  between  the  versions  is  largely  due  to  differences 
between  the  relatively  uninteresting  categories  that  correspond 
to  statements  that  were  neutral  about  the  outcome  of  the  battle. 

The  propositional  analysis,  shown  in  Table  18,  produced  no 
differences  in  the  number  of  different  propositions  or  singletons 
between  the  two  versions;  however,  this  passage  produced  a 
considerable  number  of  singletons,  more  than  tran spcr tati on 
( X“2( 1 )=26 . 093 »P< . 01 ) .  In  the  clusters,  no  readers  of  the  baa 
version  used  the  idea  that  the  British  won,  while  some  good 
version  readers  did  (  X'* 2 (  1  )  =  7 . 860  ,  p<  .  01  ) .  This  disagrees  with 
the  results  for  the  the  response  categories  described  above.  The 
discrepancy  can  be  reconciled  on  the  basis  that  the  explicit  main 
idea  sentence  in  the  good  version  induced  some  consistency  in  the 
form  of  the  responses,  so  that  some  clusters  appeared  in  the  good 
version.  But  in  the  bad  version,  subjects  stated  their  main  idea 
in  a  variety  of  ways,  without  the  guidance  of  an  explicit  main 
idea  sentence.  So,  the  few  subjects  who  stated  the  idea  of 
British  victory  did  so  in  essentially  unique  ways,  resulting  in 
no  clusters  expressing  this  idea  in  the  bad  version. 


DISCUSSION 


Conclusions 

Although  each  of  the  passages  described  has  its  own 

peculiarities,  several  conclusions  emerge  from  the  results. 

The  good  versions  had  obvious  main  ideas  in  the 

generalization  passages ,  bu t  no t  in  the  construction  passages  . 
This  suggests  that  the  structure  of  generalization  passages  is 
very  clear  and  simple  compared  to  the  construction  passages, 
corresponding  to  the  difference  in  complexity  of  the 

macrostructure-building  rules.  The  explicit  generalization  main 
idea  sentence  is  very  recognizable,  perhaps  on  the  basis  of 
superficial  features,  since  it  was  easily  spotted  by  the  subjects 
even  in  the  unfamiliar  instruments  passage.  One  candidate  for 
such  a  superficial  feature  is  the  appearance  of  general  rather 
than  specific  terms.  The  fact  that  the  intended  main  idea  was 
not  as  obvious  in  the  construction  passages  is  intriguing.  Of 
course  a  possible  explanation  is  that  the  construction  passages 
were  simply  of  inferior  quality,  so  that  in  fact  they  were 
organized  only  poorly  around  the  intended  main  idea.  But  the 
familiar  transpcrtati on  passage  produced  extremely  consistent 
responses  stating  the  intended  main  idea,  but  nonetheless,  the 
explicit  main  idea  sentence  was  rated  as  only  fairly  important, 
rather  than  unanimously  most  important  as  in  the  generalization 
passages.  Hence,  the  basic  conclusion-argument  form  underlying 
the  construction  passages  must  be  in  some  sense  less  tight  in  its 
macrostructure  than  the  generalization-example  form.  If  for  no 
other  reason,  the  interconnected  arguments  supporting  a 
conclusion  may  be  viewed  as  tightly  bound  up  with  the  conclusion, 
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Table  18 

Propositional  Analysis  for  the  Jutland  Passage 


Version 


Good 

Bad 

170 

162 

Total  Number  of  Proposition 

109 

102 

Different  Propositions 

91 

81 

Different  Singletons 

15 

7 

Subjects  In  Clusters 

Number  of  Subjects  Producing  Each  Cluster 


Version 


Good 

Bad 

Cluster  Description 

7 

0 

the  British  Navy  won  a  [strategic]  victory  [in  the 
Eattle  of  Jutland];  the  British  Navy  defeated  the 
German  Fleet 

3 

0 

a  major  strategic  victory;  the  Battle  of  Jutland  was 
the  major  victory 

6 

7 

in  the  Battle  of  Jutland;  the  Battle  of  Jutland  was 
a  [major]  naval  battle  [in  VlWI]  ;  the  Battle  of 

Jutland  was  fought  between  the  British  Navy  and  the 
German  Fleet 

2 

0 

fragment:  but  not 
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but  the  fairly  unrelated  specific  examples  of  a  generalization 
are  easily  separable  from  the  generalization  itself. 

Relevant  and  irre levant  sentences  can  be  distinguished  even 
_in  unfamiliar  material .  One  would  expect  that  readers  could 
distinguish  relevant  information  in  familiar  passages.  However, 
an  intuitive  prediction  of  how  instruments  and  Jutland  would  be 
handled  was  that  readers  would  be  completely  befuddled  and  unable 
to  make  any  sense  out  of  the  passage  whatever.  However,  their 
importance  ratings  were  well-behaved,  and  show  that  they  can  tell 
what  is  important,  and  organize  the  bad  versions  of  the  passage 
around  other  main  ideas.  To  a  great  extent,  the  problem  in  these 
passages  seems  to  be  in  formulating  a  statement  of  the  main  idea, 
rather  than  in  identifying  the  important  content. 

Explicit  main  ideas  are  echoed  i n  the  responses .  Given  that 
readers  can  spot  an  explicit  main  idea,  they  have  a  strong 
tendency  to  model  their  responses  on  that  sentence.  This 
appears,  for  many  of  the  passages,  in  the  great  similarity  of  the 
most  popular  response  categories  in  the  good  versions  to  the 
intended  main  idea  sentence.  Another  indication  is  the  general 
tendency  for  more  propositional  clusters  to  appear  in  good 
version  responses  than  in  bad  version  responses.  The  guidance 
provided  by  the  good  version  is  weaker  in  the  unfamiliar 
passages,  but  this  could  be  due  to  the  relatively  complex 
intended  main  ideas  in  instruments  and  Jutland . 

When  a  main  idea  is  not  explicit  in  a  familiar  passage  , 
r  eader s  can  produce  one .  It  is  clear  from  metals , 
t ransportati on ,  and  Watergate  that  readers  can  produce  main  ideas 
of  high  quality  for  passages  that  are  reasonably  familiar  even  if 
they  are  not  explicitly  stated.  The  t imekeeping  and  instruments 
passages  seem  to  revert  to  an  alternate  organization  when  the 
intended  main  idea  is  not  explicit,  but  only  some  readers  pick  up 
the  alternate  structure.  Hence,  for  unfamiliar  passages,  lack  of 
an  explicit  main  idea  will  result  in  inconsistent  responses 
reflecting  the  different  alternate  organizations  that  the  passage 
might  have,  and  the  idiosyncratic  knowledge  and  strategies  of 
individual  readers. 

Readi ng  times  do  not  a lway s  show  version  effects .  For  the 
generalization  passages,  the  reading  times  make  a  nice  pattern: 
The  familiar  metals  passage  produced  neither  reading  time  nor 
response  content  differences  between  versions.  The  unfamiliar 
t ime keeping  and  i nstruments  passages  produced  both  reading  time 
and  response  content  differences.  However,  the  only  construction 
passage  showing  a  time  difference  was  Watergate ,  where  the  effect 
was  weak,  and  the  responses  were  not  different.  Transportati on 
was  very  familiar  and  produced  both  very  similar  responses  and 
reading  times  in  the  two  versions,  but  Jutland  was  very 
unfamiliar,  and  produced  responses  that  were  similiar  in  their 
poor  quality  for  the  two  versions,  and  reading  times  that  were 
also  similar  in  their  great  length.  However,  there  is  an  obvious 
and  very  strong  ordering  of  mean  reading  times  across  passages 
that  corresponds  well  to  their  familiarity.  Hence  the 
inconsistent  appearance  of  reading  time  effects  could  be 
explained  as  follows:  In  generalization  passages,  lack  of  an 
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explicit  main  idea  results  in  longer  reading  time  if  an 
equivalent  main  idea  is  not  easily  inferred  due  to  unfamiliar 
content.  In  the  construction  passages,  the  explict  intended  main 
idea  sentence  is  not  as  important  relative  to  the  rest  of  the 
passage  as  is  the  case  in  the  generalization  passages.  Hence 
whether  or  not  it  is  present  is  relatively  unimportant  to  the 
reading  time;  any  effects  are  likely  to  be  masked  by  the  ease  of 
inferring  a  main  idea  if  the  passage  is  familiar,  or  the  overall 
difficulty  of  understanding  the  passage  at  all  if  it  is 
unfami li ar . 


A  Model  for  Generating  Main  Ideas 

An  informal  model  that  explains  some  of  the  main  features  of 
the  results  is  shown  in  flowchart  form  in  Figure  1.  The  reader 
first  determines,  on  the  basis  of  superficial  features,  whether 
the  first  sentence  appears  to  state  a  main  idea.  If  so,  it  is 
used  as  the  candidate  main  idea  for  the  passage.  If  not,  the 
reader  attempts  to  extract  a  main  idea  based  on  the  first 
sentence,  and  use  this  as  the  candidate  main  idea.  Then  the 
reader  determines  whether  the  rest  of  the  passage  can  be  subsumed 
under  the  candidate  main  idea.  If  so,  the  reader  outputs  that 
main  idea  and  stops.  If  not,  the  reader  attempts  to  devise  a 
main  idea  based  on  the  whole  passage  content. 

The  various  boxes  in  the  model  can  be  justified  as  follows: 
The  special  role  given  to  the  first  sentence  is  consistent  with 

(a)  the  previous  work  on  initial  mention  effects  cited  above; 

(b)  the  importance  ratings  given  to  the  first  sentences;  note 
how  the  first  sentence  of  the  bad  versions  was  rated  as  more 
important  than  when  the  same  sentence  appears  in  the  good 
version,  and  usually  as  more  important  than  later  sentences  in 
the  bad  version;  (c)  the  tendency  of  good  version  readers  to 
echo  the  initial  explicit  main  idea  sentence.  That  this  special 
role  for  the  first  sentence  can  take  effect  before  the  rest  of 
the  passage  is  considered  seems  to  be  justified  by  the  apparent 
superficial  differences  between  explicit  main  idea  sentences  and 
the  other  passage  sentences,  such  as  the  use  of  general  nouns 
rather  than  specific  ones.  That  readers  might  base  a  main  idea 
on  a  first  sentence  that  is  not  an  obvious  main  idea  sentence  is 
supported  to  some  extent  by  the  generally  high  importance  ratings 
given  the  first  sentence  in  the  bad  versions.  However,  it  seems 
reasonable  that  in  this  experiment  readers  could  often 
hypothesize  a  main  idea  from  the  first  sentence,  for  example,  by 
generalizing  it.  However,  more  direct  evidence  is  needed  on  this 
point . 


The  decision  about  whether  th 
subsumed  is  obviously  a  very  complex 
are  a  possible  basis  for  how  this  mi 
Dijk's  GENERALIZATION  rule  is  appare 
application  than  the  CONSTRUCTION  ru 
the  subsumption  decision  is  easi 
generalization  passage  than  for  a 
that  the  model  says  that  the  reade 
based  on  the  first  sentence,  and  the 


e  rest  of  the  passage  is 
one;  van  Dijk's  macro-rules 
ght  be  done.  Given  that  van 
ntly  much  simpler  in  form  and 
le,  it  seems  reasonable  that 
er  and  more  consistent  for  a 
construction  passage.  Note 
r  tries  a  candidate  main  idea 
n  simply  outputs  it  if  it  is 
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FIGURE  1. 


adequate  to  subsume  the  rest  of  the  passage.  This  is  justified 
by  the  tendency  to  reproduce  the  explicit  main  idea;  hence 
alternative  macrostructures  for  the  passage  appear  rarely  in  the 
good  versions,  because  according  to  the  model,  the  reader  does 
not  consider  any  candidate  except  the  explicit  main  idea. 

The  process  that  tries  to  extract  the  main  idea  from  the 
whole  passage  if  the  subsumption  attempt  fails  is  poorly  defined 
at  this  point.  Again,  it  should  be  based  on  the  macro-rules,  but 
there  may  be  a  schema-directed  component  as  well.  That  is,  a 
common  alternative  organization  for  the  bad  versions  was  the 
sequence-climax  form.  This,  and  other  fine  details  of  the 
results,  suggests  that  readers  apply  a  passage  schema  which  helps 
organize  the  passage  by  suggesting  which  propositions  are 
important  to  the  macrostructure.  In  fact,  the  model  assumes  one 
such  schema,  the  form  of  initial  main  idea  followed  by  support. 
Hence  the  extraction  box  may  consist  of  a  series  of  attempts  to 
apply  flowcharts  similar  to  Figure  1. 


Pros  pect  s 

These  results  show  that  it  is  possible  to  study  the 
macrostructure  building  process  fairly  directly,  although  such 
work  will  be  complicated  and  may  have  to  consist  of  loose 
generalizations  from  the  results  of  several  individual  passages, 
rather  than  statistical  generalization  from  several  passages 
supposedly  identical  in  form.  Further  work  will  be  to  collect 
think-aloud  protocols  which  should  reveal  much  about  the  model, 
and  development  of  the  model  in  the  explicit  form  of  a  set  of 
production  rules  based  on  van  Dijk's  rules. 
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